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A thermodynamic system is driven into a nonequilibrium condition when a time-dependent force 
or a nonconservative force represented by a protocol \{t) is applied. Such a system is time irreversible 
in the sense that the motion under a protocol A(0 < t < t) and the time-reversed motion under 
A(t — t) are not equally probable. We investigate a stochastic echo phenomenon in which a system 
is controlled by an optimal protocol to display the time-reversed motion. The optimal protocol is 
derived for a Langevin system. For the time-dependent driving case, simple harmonic oscillator 
systems are found to display the perfect stochastic echo phenomenon. We also show that any 
system driven by a time-independent nonconservative force has a dual system displaying the perfect 
stochastic echo phenomenon. Our study provides a novel perspective on the time-irreversibility of 
nonequilibrium systems. 
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Introduction - The Loschmidt echo is the characteris- 
tic feature of time reversible systems. A classical system 
returns to its original state when the velocity of all parti- 
cles is reversed. A quantum mechanical system evolving 
under the Hamiltonian H and subsequently under —H 
returns to the initial state. An echo phenomenon also 
occurs in a driven macroscopic system. One of the most 
popular examples is a drop of dye placed in a highly vis- 
cous fluid in the gap between two concentric cylinder [ij . 
When the inner cylinder is rotated, the drop spreads ap- 
parently uniformly in the fluid. Surprisingly, the drop 
reappears when the rotation is reversed. A recent ex- 
periment reports a transition between the reversible and 
irreversible regimes as a strength of the driving is var- 
ied , although it is controversial whether it is a sharp 
phase transition Q or a smooth crossover Q ■ 

An equilibrium system with Langevin dynamics obeys 
the detailed balance condition [sj 

Peq{x,)P{Xf,tf\Xi,ti)^Peq{Xf)P{Xi,ti\Xf,tf) , (1) 

where peq denotes the equilibrium distribution function 
and P{x' ,t'\x,t) denotes the transition probability from 
X at time t to x' at time t' . The detailed balance implies 
that the motion along a path and the time-reversed mo- 
tion are equally probable. Hence, an equilibrium system 
displays an echo phenomenon in the probabilistic sense. 

When a thermodynamic system is exerted by a time- 
dependent force or a nonconservative force, it is driven 
into a nonequilibrium condition [^-Q. The nonequilib- 
rium driving is represented by a protocol A(i), which 
may depend on time or not. A nonequilibrium system 
does not obey the detailed balance. So a motion along a 
path under a protocol A(0 < t < t) and its time-revered 
motion under a time-reversed protocol X^{t) = A(r — t) 
are not equally probable. In fact, the difference in the 
statistical weights between them is directly related to 
the entropy increase, which is the basis for the various 



nonequilibrium fluctuation theorems 

The time irreversibility raises a question about the ex- 
tent to which stochastic motions of a nonequilibrium sys- 
tem can be reversed in time. The absence of the detailed 
balance and the entropy increase indicates that a time- 
reversed protocol does not lead to an echo phenomenon. 
However, it is little known under which protocol the time- 
reversed motions are simulated best. We will call the 
controlled time-reversed motion a stochastic echo phe- 
nomenon (SEP). In this paper, we derive the condition 
for the optimal protocol for the SEP in nonequilibrium 
systems with Langevin dynamics. We begin with a re- 
view on stochastic thermodynamics for nonequilibrium 
Langevin systems. Then, the optimal condition for the 
SEP will be derived. The SEP will be further investi- 
gated in systems with time-dependent forces and with 
time-independent nonconservative forces. We conclude 
the paper with summary and discussions. 

Langevin dynamics - We concentrate on the over- 
damped dynamics of a system of coordinate x = 
(xi, • • • , xjy) exerted by a force fx(t){x). The force de- 
pends on a protocol X{t) representing a time-dependent 
force or a time-independent nonconservative force. The 
Langevin equation reads 0] 



m ^ fmixit)) + V2T -nit) 



(2) 



where T is the temperature of the heat reservoir and 
ri{t) is the ^-correlated thermal noise with {7]i{t)) = 
and {'ni{t)rij{t')) = 6ijS{t — t'). The damping coefficient 
and the Boltzmann constant arc set to 1. 

The initial probability density for a;(0) will be denoted 
by pi(a;(0)). Then the dynamics determines the proba- 
bility density pf{x{T)) for x{t) at time t ~ t and the 
probability density functional for a path x{t) in the in- 
terval < < < T. It is given by [H, 



P4x] ^ p,{x{Q))e-''^^'f- 



(3) 
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with the action 
fx] = 



For convenience, we adopt the Stratonovich convention 
for the stochastic integral throughout the paper 

Suppose that the system follows a path x(t) under a 
protocol X{t). The time-reversibility and the total en- 
tropy change are related through the relation [l^l 



AStot [x] = In 



Vx[x] 



(5) 



where V^r [x] = Vxr [x^] denotes the probability density 
functional for a time- reversed path x^it) = x{t — t) un- 
der a protocol X^{t) = A(t — t). It can be decomposed 

\x] + ASres [ 



as AStot [x] = ASsys 

ASsys [x] = - In 



x\, where 
PfjxjT)) 

P:{xm 



(6) 



is the change in the system entropy and AiSresia^] — 
Q[x]/T is the change in the heat bath entropy with the 
heat 



Q[x] 



dt x{t) ■ fx(t){x{t)) 



(7) 



The quantity — Q[a;] is equal to the work done by the 
damping force and the random force. So, Q[x\ is the 
same as the heat dissipated into the heat bath. 

It is noteworthy that the average value of AStot is the 
relative entropy (or Kullback-Leibler divergence) of V\ [x] 
with respect to ^^^[a;] 0: 



{AS 



totlVx 



D{V> 



(8) 



The relative entropy of p{x) with respect to q{x) is de- 
fined as D{p\\q) = (Ingfl)^ = / p(x)ln£g. It is 
nonnegative for any probability distributions p and q with 
^(p|k) = if and only \ip{x) = q{x) almost everywhere. 
So the entropy never decreases and the echo phenomenon 
fails with a time-reversed protocol A^. 

Stochastic echo phenomenon ~ In order to find the op- 
timal protocol for the SEP, we introduce an imaginary 
system subject to a force fK.(t){x) with a protocol K{t). 
The initial state of this system is taken to be the final 
state of the original system with the force f\. So the 
probability density functional for a path x(t) in the inter- 
val < t < r is given by [a;(t)] = pf{x{0))e-^^''-f''l 

The optimal protocol can be obtained by minimizing 
the relative entropy 



S[K;X]^D{Vx\\Vi 



(9) 



with respect to k. The relative entropy is useful since 
it is nonnegative and zero only for the perfect SEP with 



V\[x] = V^[x\ = Vk[x^]. It reduces to the average value 
of the total entropy change for the special choice k = 

. Consequently, it also provides a bound for the total 
entropy change, (AStot) = §[A^; A] > min^ S[k; X] > 0. 

Before proceeding, we remark that the optimal proto- 
col has also been considered in a different context. Sup- 
pose that a variation of an external parameter from A,; at 
time < = to A/ at time t = t. One may ask a question 
about the optimal control of X(t) which yields the mini- 
mum entropy production [3 • Note that this optimal 
protocol for the minimum entropy production is different 
from the optimal protocol for the SEP. 

For a notational simplicity, we introduce fj,(t) = 
K^{t) = k{t — t). The relative entropy is rewritten as 



§[k;A] 
where 



In 



Pfix{T)) 



IMxio)) 



Vx 



(10) 



ix] = -C[x:fx] + C[x'';f,] 



r dt[x-{h+f,)/2-{fi-fi 

Jo 



/4 



(11) 



with fx = f\{t)ixit)) and = f^,{r-t)ixit)). Deriving 
the second equality in Eq. (|lip . we made a change of 
a variable t ^ r — t for C[x^;fi^]. The first term in 
the righthand side of Eq. (|10p is equal to (ASsys), which 
is independent of fi{t). So it suffices to minimize the 
average value of Q. The functional Q will be called a 
pseudo-heat since it reduces to the heat Q (sec Eq. ([7])) 
when ^(t) = X{t). 

The pseudo-heat is minimized at the optimal protocol 
fiop satisfying ^(Q)/^/^(OUop ~ ^- 1* yields that 



TV, 



df, 

/ Vx 



= 0. (12) 



It becomes simpler when the force is decomposed as 

fx{x) ^ g{x) + Xit)h{x) (13) 

with auxiliary force fields g and h. Then, the SEP is 
achieved with the force /^h {t){x) = g{x)+ iiop{T — t)h{x) 
with the optimal protocol 



Mop(i) 



({x{t)+g{x{t))+TV^)-h{x(t)))vx 



(h{x{t)T^ 



^Vx 



(14) 



In the Stratonovich calculus, x{t) ■ F{x{t)) should be 
interpreted as limst^o Jt{x{t + St) — x{t\) ■ ^{F{x{t + 
St)) + F{x{t))) for any vector field F{x) [g. It yields 

(x ■ F{x))rx = ({fx + TV,) • F{x))rx ■ (15) 
It further simplifies the optimal condition to the form 

-TV^)-h), 



(h^) 



Vx 



(h^) 



Vx 



(16) 



3 



where function arguments are omitted for simplicity. 
Hereafter, the average (•) is to be taken with respect 
to Vx unless stated otherwise. The deviation (^op — A) 
is proportional to the nonequilibrium work done by the 
nonconservative force. Note that (5^(Q)/(5i^|^^ = {h?) > 
0. Hence, 5{Q) /dt\f^^^ = indeed provides the minimum 
of the pseudo-heat. 

The efficiency of the SEP can be measured by the rel- 
ative entropy Sop = S[k = ^J.op^, M = {^sys) + {Qop)/T 
with Qop = Q|p„y. We define the pseudo-heat dissipa- 
tion rate Qop as the integrand of Eq. with fi = flop- 
A straightforward calculation shows that 

(Qop) = (Q)-i(A-Mopf(/i'> , (17) 
where the average heat dissipation rate is given by 

{Q) = {x-fx) = {{fx+TV^)-fx). (18) 

It is manifest that (Q) > (Qop)- 

We will apply the formalism developed to systems with 
time-dependent and time-independent protocols sepa- 
rately. 

Time dependent X{t) case - We demonstrate the SEP 
with two solvable examples. First, consider a har- 
monic oscillator in one dimension whose stable position 
is dragged according to a given protocol X{t). The force 
is given by 

/A(t)(x) = -fc(x--A(i)) (19) 

with a force constant k. Without loss of generality, we 
wiU set A(0) = 0. This system describes a bead trapped 
by an optical tweezer or an electric charge in an electric 
circuit (Mil. 

The probability distribution for x{t) is known ex- 
actly (see e.g., Ref. [1^). The particle is assumed to fol- 
low the Boltzmann distribution pi{x{0)) oc e~'^^^°) /i^T) 
at t = 0. Then x{t) follows the Gaussian distribution at 
all t with the mean {x{t)) = A(t) and the variance {{x{t)— 
A(t))2) = T/k, where A{t) = k J* ds X{s)e- 'I 

The system corresponds to the case in Eq. ([T51) with 
g{x) = —kx and h{x) = k. Hence, the optimal protocol 
from Eq. (|16p is given by 

A*op(0 = -X{t) + 2{x{t)) = -X{t) + 2A{t) . (20) 

The probability distribution for x{t) follows the Gaus- 
sian distribution with a constant variance at all t. So 
the system entropy does not change. The pseudo-heat, 
evaluated from Eqs. ([TT]) and also vanishes while 
(Q) = fc2(A — A)2. Therefore the relative entropy Sop 
vanishes and the SEP is perfect. 

Figure [T] illustrates the perfect SEP with a protocol 
A(t) = vt. The initial position a;(0) is drawn from the 
Boltzmann distribution pi{x{0)) ^ g-kx{0) /(2T)^ ^j^^. 




t 



FIG. 1. (Color online) Sample paths of a dragged harmonic 
oscillator. Thin lines represent paths under A (black, < 
t 1^ t), (red and dashed, t < t < 2r), and flop (blue, 
T < t < 2r). Thick lines represent the stable position under 
corresponding protocols, k — T — v — 1 and r — 10. 

interval < t < r, the particle is driven under the pro- 
tocol X{t). Subsequently, in the interval t < t < 2t, 
the particle is driven under the time-reversed protocol 
A(2t — t) or the optimal protocol fiop(2T — t) where 
^op(t) = -A(t) -t- 2A(i) = wt - 2v[l - e-^^)/k. The SEP 
is evident under the optimal protocol. 

As a second example, consider a particle in one dimen- 
sion subject to a force 

fxit){x) ^ ^X{t)x (21) 

with a time dependent force constant X{t) |22[. The 
solution of the Langevin equation is given by x{t) = 
x(0)e-^(*'") -f- V2T J^dt'e-^'^'^^'^Tfit'), where K(t,t') = 
J^, dsX{s). The initial position x{0) is also taken to follow 

the Boltzmann distribution pi{x{0)) oc 6"^^°''''^°^^/'^^-^'. 
Then, a;(t), being the sum of independent Gaussian ran- 
dom variables, follows the Gaussian distribution with the 
mean {x{t)) =^ and the i-dependent variance 

(a;(t)2) = J_g-2K(t,o) ^ 2T f dt'e-2^(*^*') . (22) 
A(0) Jo 

This system corresponds to the case in Eq. (|13p with 
g{x) — and h{x) = —x. From Eq. (jl6|) . we find that 
the optimal protocol for the SEP is given by 

2T 

t^opit) = - A(t) . (23) 

In this case, the probability distribution for x{t) changes 
its shape. So the system entropy varies with time as (see 
Eq.dH)) 

1 (x(t)'^) 

{ASsys) = {Ssysit)) ~ {SsyM) = 2 1^ ■ (24) 

Differentiating it with respect to t and using Eq. (|22p . 
one finds that the system entropy increase rate is given 



4 



by 

The pseudo-heat production rate is also calculated using 
Eqs. (UHl) and It is given by 

In this case, (Ssys) + {Qop)/T = while (Ssys) and (Qop) 
are nonzero individually. Therefore the optimal protocol 
also leads to the perfect SEP. 

Time-independent A case - One can drive a system into 
a nonequilibrium condition by applying a nonconserva- 
tive force Then, a total force can be decomposed 

as 

Mx) = f,{x) + \f,,,{x) , (27) 

where fc{x) = —'Va;V{x) denotes a conservative force 
with a scalar function V{x) and \fnc{x) denotes a non- 
conservative force. In this time-independent A 
represents the strength of a nonconservative force. In 
comparison with Eq. p^ . g = fc and h = fnc- 

Suppose that the system is in the nonequilibrium 
steady state (NESS) with the probability distribution de- 
noted hy Pss{x) = e"*^"^^^. In the NESS, the system en- 
tropy is constant while there is an heat dissipation at a 
constant rate (Q) = {x ■ fx)ss = A(a; • /„c)ss, where {■)ss 
denotes the average over the NESS [7|. Note that the 
average rate of the work done by the conservative force 
is zero, {x ■ fc)ss = -f^{V{x{t)))ss = 0. 

The optimal protocol for the SEP is rephrased as 

\ o {fc ' fnc + X ' fnc)ss ^•r)0^ 
^op - -A - Z . 

[Jnc/ss 

It is constant since the averages are taken over the NESS. 
From Eqs. ((T7)) and the average pseudo-heat dissi- 
pation rate is given by 

{Qor,)ss = {Hfnc)ss - {X ■ fnc)ss) ■ (29) 

The pseudo-heat does not vanish in general. Therefore 
the relative entropy Sop is nonzero and the SEP is im- 
perfect. 

Note that the decomposition of a given force / into the 
form in Eq. (f27|) is not unique. One can add and subtract 
a gradient of any scalar function to the conservative and 
from nonconservative forces, respectively Q. Making use 
of the arbitrariness and redefining A, one can choose 

Mx)^^TVMx) ■ (30) 

The NESS ^^^(a;) e-'*"^^) is the steady state solution 
of the Fokkcr-Planck equation [H 

^ = V-(-/A + TV.)p. (31) 



The steady state condition yields that 

{-{VM + V.) • {fx + TV,0.,s) = . (32) 

If one adopts the choice in Eq. ([30]). the steady state 
condition becomes 

fc ■ fnc + TV ■ fnc = . (33) 

The converse is also true. If the decomposition in Eq. ((27)) 
satisfies Eq. ([33]). it implies Eq. (pO| . The steady state 
condition along this line was mentioned in Ref. [25| . 

The special choice of fc = —TV xipss turns out to 
be extremely useful. The optimal protocol is given by 
/iop = —A. which means that one needs to reverse the 
direction of the driving force for the SEP. The pseudo- 
heat dissipation rate, evaluated directly from Eq. (fTTj) 
with /i = — A and Eq. ([33]) . is given by Qop — x ■ 
fc = —T-^<t)ss{x[t))^ whose average value vanishes in 
the NESS. Therefore, we conclude that a nonequilibrium 
system driven by a nonconservative force can display the 
perfect SEP. Precisely speaking, a system being exerted 
by a force / = {-TV x4iss) + {f + TV x(j)ss) is equivalent 
to its dual system being exerted by a dual force fduai = 
-TVx'l>ss-{f + TVxC^ss) - -f{x)~2TV(j>,s{x). Both 
systems have the same NESS and are linked through the 
time-reversal operation. 

Summary and discussion - We have investigated the 
SEP in nonequilibrium systems driven with a time- 
dependent force or a nonconservative force. By mini- 
mizing the relative entropy in Eq. (jlOp . we have derived 
the optimal condition for the SEP in Eq. (fT6|) . Our study 
shows that stochastic motions of nonequilibrium system 
can be reversed under the precise control using the opti- 
mal protocol. 

The harmonic oscillator system, whose stable position 
or force constant is varying with time, is shown to dis- 
play the perfect SEP. It remains uncertain whether the 
harmonic oscillator is an exceptional case or not. Fur- 
ther studies on even more complicated systems are nec- 
essary. Nonequilibrium systems driven by a constant 
nonconservative force are also shown to display the per- 
fect SEP. As a byproduct, we discover that any driven 
system has a dual system. They are symmetric under 
the time reversal and share the same NESS. The dual- 
ity may shed some light on the general property of the 
NESS. The pseudo-heat plays an important role in the 
time-reversibility of nonequilibrium systems. The physi- 
cal meaning of the pseudo-heat is an open question. The 
expression in Eq. ([29]) suggests that the it might be re- 
lated to the violation of the fluctuation dissipation rela- 
tion in the NESS [IB-iil. It should be scrutinized fur- 
ther. We also propose the the SEP can be used for the 
test of stochastic thermodynamics in experimental sys- 
tems. 
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